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[57] ABSTRACT 

A computer network is provided with a low-complexity 
sequence identification number determination method. In 
one embodiment, the computer network comprises a local 
node coupled to a remote node by a serial communications 
link to conduct data exchanges with the remote node. Each 
data exchange is provided with an exchange identification 
number, and each data exchange is made up of sequences of 
consecutive frames. Each sequence transmitted from the 
local node is assigned a sequence identification number by 
the local node. To maintain the uniqueness of the serial 
identification numbers of concurrently active sequences, a 
portion of each serial identification number is set equal to the 
exchange identification number of the data exchange of 
which the sequence is a part. The exchange identification 
number may be one assigned to the exchange by the remote 
node. In one implementation, the sequence identification 
number is a byte having the six most significant bits set 
equal to the exchange identification number. The local node 
may include a serial communications transceiver coupled to 
a transmit controller and a receive controller. The transmit 
controller would then generate frame headers for each data 
frame and determine the sequence identification number to 
be included. 

12 Claims, 3 Drawing Sheets 
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SYSTEM AND METHOD FOR 
ESTABLISHING UNIQUE SEQUENCE 
IDENTIFICATION IN AN INFORMATION 
EXCHANGE OF A SYSTEM NETWORK 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to the field of computer networking, 
and in particular to a low complexity information exchange 
management system. 

2. Description of the Related Art 

Internetworking of high-performance computers has 
become the focus of much attention in the data communi- 
cations industry. Performance improvements in processors 
and peripherals, along with the move to distributed archi- 
tectures such as client/server, have spawned increasingly 
data- intensive and high-speed networking applications, such 
as medical imaging, multimedia, and scientific visualization. 
However, the interconnections between the systems and 
their input/output devices cannot keep up with the blinding 
data rates, nor can they provide the distances needed for 
local area networks spanning campus-wide areas. 

According to "Amdahl's Law", a megabit per second of 
input/output (I/O) capability is needed for every MIPS of 
processor performance. Current communications standards 
top out at just over 100 megabits per second, not nearly fast 
enough, as technical computing applications already 
demand processors exceeding 1,000 MIPS. The deficiencies 
in current transmission rates results in the communications 
channel becoming a bottleneck to system performance. 

A new protocol known as Fibre Channel is 10 to 250 times 
faster than existing networks, transmitting at rates exceeding 
1 Gbps in both directions simultaneously. It defines standard 
media and signaling conventions for transporting data in a 
serial fashion, it provides an error correcting channel code 
and a frame structure for transporting the data, it sets out a 
flow control methodology, creates some common services, 
and supports interfaces to existing higher level protocols 
such as SCSI (small computer system interface). The Fibre 
Channel protocol can be applied to various network topolo- 
gies including point-to-point, ring, and switched. The Fibre 
Cbannel protocol is being proposed as an ANSI (American 
National Standards Institute, Inc.) standard, and a multitude 
of reference material is readily available at hup:// 
www.fibrechannel.com. 

Communication across the Fibre Channel is provided 
using data frames. Consecutive data frames travelling in one 
direction form a sequence, and a group of related sequences 
combines to form an exchange. The higher level protocols 
supported by Fibre Channel perform "operations" such as: 
open, read, write, close, etc. An exchange may correspond to 
one of these operations. Each active sequence in an 
exchange is provided with a unique sequence identifier. This 
and other limitations on the sequence identifier are set forth 
in the Fibre Channel standard FC-PH (X3.269-199X revi- 
sion 12) which is hereby incorporated by reference. 

Each data frame incorporates a frame header immediately 
following a start-of-frame delimiter. The frame header 
among other things includes the sequence identifier. The 
following table describes the structure of the frame header: 
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The identity of each data frame is uniquely specified by the 
S_ID, D_ID, SEQ_ID, SEQ_CNT, and Sequence Context 
values. The OX_ID and RX_ID fields (generically referred 
to as the X_ID fields) may be used by a node to provide a 

15 locally assigned value to use in place of the S_ID, D_JD, 
and SEQ_ID values to identify frames in a sequence. A 
node makes use of these ID values in an implementation- 
dependent manner to uniquely identify open sequences. The 
description of each of the fields in the frame header is now 

20 provided. 

R__CTL is a one byte field for routing control. It contains 
routing bits and information bits that categorize the frame 
function. Routing bits differentiate frames based on function 
or service within a node. These may indicate frames related 

25 to a specific upper level protocol operation or specify that 
the frame payload is to be directed to a video buffer (for 
example) without passing through the main data store. The 
information bits interpretation is dependent upon the routing 
bits field value, and may be an information category (i.e. 

30 solicited/unsolicited data/control/status) or a command. 
Each node has an address identifier which is unique 
within the local address domain. D_ID is a three byte field 
that contains the address identifier specifying the destination 
of the frame, and S_ID is a three byte field that contains the 

35 address identifier specifying the source frame. 

TYPE is a one byte field which is generally provided for 
specifying the data structure type (determined by the higher 
level protocol) of the frame content, but may also be used for 
indicating a reason code for a rejected frame. F_CTL is a 

40 three byte field that contains control information relating to 
the frame content and sequence flow control. Various flags 
are provided to indicate the status of the sequence and other 
flow control functions. The Sequence Context flag is in the 
F_CTL field, and it indicates whether the S_ID or D_ID 

45 node initiated the sequence. 

SEQ__ID is a one byte field assigned by the sequence 
initiator. The SEQ_ID is unique for a specific D_ID and 
S_ID pair while the sequence is open. If the sequence 
initiator initiates a new sequence for the same exchange 

50 before receiving the final acknowledgement for the previous 
sequence, it is termed a streamed sequence. If streamed 
sequences occur, the sequence initiator must use X+l dif- 
ferent consecutive SEQ_IDs where X is the number of open 
sequences per exchange. If consecutive non-streamed 

55 sequences for the same exchange occur during a single 
sequence initiative, the sequence initiator must use a differ- 
ent SEQ_ID for each consecutive sequence. This may be 
accomplished by alternating between two SEQ_ID values. 
DF_CTL is a one byte field that specifies the presence of 

60 optional headers at beginning of the data field for data 
frames. SEQ_CNT is a two byte field that indicates the 
sequential order of data frame transmission within a single 
sequence or multiple consecutive sequences for the same 
exchange. The sequence count of the first data frame of the 

65 first sequence of the exchange shall be binary zero, and the 
sequence count of each subsequent data frame in the 
sequence shall be incremented by one. If a sequence is 
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streamed the sequence count of the first data frame of the FIG. 1 shows a system network with exemplary nodes 

sequence is incremented by one from the sequence count of coupled via serial links; 

the last data frame of the previous sequence (i.e. continu- FIG. 2 shows a system network configured as an arbi- 

ously increasing). If a sequence is non-streamed, the starting trated loop; 

sequence count may be continuously increasing or binary 5 FIG. 3 shows a serial communication transceiver; and 

zero. The sequence count wraps around to zero after reach- FIG. 4 shows a network interface unit, which uses indirect 

ing a value of 65535. addressing to access an exchange table. 

OX IDisatwo bytefleld thatidenliflestheexchay ID ^ 5 showg a w re p reseD tation of a sequence 

assigned by the originator of the exchange. Each exchange number 

is assigned an identifier unique to the originator or 1Q ^ susceptible to various modifica- 

^"SSth^nxT^ *»* *"* alternative forms > s P ecific embodiments thereof 

block associated with the OX_ID is used to track the ^ ^ and ^ 

progress of a series of sequences which comprises an . . . . J * . , t K. . , , , , & . t , 

exchange. Similarly, RX ID is a two byte field assigned by herein be described in detad It should be understood, 

the responder to provided unique, locally meaningful idea- however > that ^ drawm f and de f ailed ^"P 1 ™ 

tificr at the responder for an exchange established by an 15 are not intended to limit the invention to the particular form 

originator and identified by an OX_ID. A responder disclosed, but on the contrary, the intention is to cover all 

exchange status block associated with the RX_ID is used to modifications, equivalents and alternatives falling within the 

track the progress of a series of sequences which comprises spirit and scope of the present invention as defined by the 

the exchange. appended claims. 

RLV_OFF is a four byte field which indicates the relative 20 DETAILED DESCRIPTION OF THE 

displacement of the first byte of each frame's payload with INVENTION 
reference to the base address of the information category. 

Providing a value for this field is optional. Turning now to the figures, FIG. 1 illustrates an exem- 
The high data rates require that a large part of the Fibre plary system network having as nodes a supercomputer 102, 
Channel protocol be handled by hardware. The hardware 25 a disk subsystem 104, a workstation 106, a bridge/router 
implementation may incur unwanted cost and complexity, 108, a mainframe 110, and a tape subsystem 112. Each of the 
particularly if a large number of concurrent data exchanges nodes is coupled to a central "fabric switch" 114 by a serial 
are to be supported. Each sequence of each data exchange link having a receive channel and a transmit channel. The 
must be tracked by the network interface so that the interface fabric switch 114 is shown nebulously since the exact 
can commence, conduct, and conclude information 3Q networktopologyisunimportanttothepresentdisclosure.lt 
exchanges in an orderly fashion, conforming to the specified jg sufficient to stipulate that the fabric switch 114 transports 
control flow and verifying the validity of each received data data frames and control words from the transmit channel of 
frame. The tracking information for each exchange is stored a SO urce node to the receive channel of a destination node, 
in a corresponding entry in an exchange table. It is desirable The number and routing of concurrent connections is deter- 
to provide a low-complexity method for supporting a large 35 mined by the fabric switch. 

number of concurrent data exchanges. 0nc spcc ific fabric switch embodiment is illustrated in 

SUMMARY OF THE INVENTION FIG. 2. The nodes are coupled in an "arbitrated loop" 

t, , , ... . , . , , t , . topology, in which the transmit channel from one node is 

The problems outlined above are in large part solved by 7! F , 6/ * , , , . c . , 

. _ t f u i i •* directly connected to the receive channel of the next node, 

a computer network which uses a low-complexity sequence » , . * i • • . j 

. i j * *• .i j , 40 In this topology, only one lmtiator-responder connection is 

identification number determination method. In one 4U x j , &J \. 3 . , , r r , , 

, t t , t , . i i j supported at a time, with the rest or the nodes simply 

embodiment, the computer network comprises a local node „ rr . , „ ,. i( _ . ... , . j 

, J# + * • . , r . ,. . t "passing along anything they receive. Using control words, 

coupled to a remote node by a serial communications link to ...... . i . . ' , . f i c lL i 

conduct data exchanges with the remote node. Each data f° mit " u fi n S node A^st arbitrates o get control of the loop, 

exchange is provided with an exchange identification ^tn notu^s a respondmg node of its destre to transmit data 

numberTand each data exchange is made up of sequences of « frame! !; ™ c ml ™ l f and responding node negotiate a 

\ C r- u . j r- mutually agreeable frame size, then the responding node 

consecutive frames. Each sequence transmitted from the .j I <r j-„ . .u • *• j r \ a * 

.... , . . t'a u u provides a buffer credit to the initiating node for each data 

local node is assigned a sequence identification number by j . . t j . Ti • . r *u 

*u i i i * t ti, e *u • i frame it has space to accommodate. Upon receipt or the 

the local node. To maintain the uniqueness of the serial . _ ■, . ■ . -5- j . 

. , .„ . . f .i buffer credits, the initiating node begins transmitting data 

identification numbers of concurrently active sequences, a . ,. m.-lu . 

poruonofeachserialidentiflcationnurnberissetequaltothe 50 frames, one per credit, until the data has been sent, 

exchange identification number of the data exchange of ^ dala b * mcs movm & ^|ween the initiating and 

which the sequence is a part. The exchange identification responding node are organized in the following manner, 

number may be one assigned to the exchange by the remote Consecutive frames moving in the same direction form a 

node. In one implementation, the sequence identification sequence. A series of related sequences (in both directions) 

number is a byte having the six most significant bits set 55 forms an exchange. Any given node may be participating in 

equal to the exchange identification number. The local node muUl P le concunent exchanges, so a network interface unit 

may include a serial communications transceiver coupled to «<*»ving d f> , &ame s must determine which exchange each 

a transmit controller and a receive controller. The transmit data frame belongs to in order to track the progress of each 

controller would then generate frame headers for each data exchange. Each data frame mcludes a frame header having 

frame and determine the sequence identification number to « (among other items) the foUowing information: a desUnation 

be included address identifier (D_ID), the exchange identifier used by 

the exchange initiator (OX_ID), the exchange identifier 

BRIEF DESCRIPTION OF THE DRAWINGS use d by the responder (RX_ID), a sequence identifier 

Other objects and advantages of the invention will (SEQ_ID) provided by the sequence initiator, and a frame 

become apparent upon reading the following detailed 65 number within the sequence (SEQ_CNT). 

description and upon reference to the accompanying draw- FIG. 3 illustrates a serial communication transceiver 300 

ings in which: that may be used by the nodes to couple to the serial 
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communications link. Transceiver 300 includes a receiver the exchange table, and then access or update the tracking 

302 coupled to the receive channel to sense incoming signal information using the location provided. This advanta- 

levels, clean them up as much as possible, and provide them geously provides a way for a large number of concurrent 

to a clock recovery module 304. Clock recovery module 304 data exchanges to be efficiently supported using an exchange 

uses the incoming signal to reconstruct a clock signal 5 tabi e 0 f limited size. During its pendency, a data exchange 

synchronized to the incoming data, and a serial-to-parallel may Dave j ts lrac iu n g information moved to and from 

converter 306 uses the reconstructed clock signal to convert system memory multiple times, and each time the exchange 

the incoming signal from serial form to parallel form. In one teble slot that the information gets stored in may change. The 

embodiment, converter 306 outputs one 10-bit channel controllers 406, 412 are able to track the changing exchange 

codeword at a time. The output from the converter 306 is 10 teble slot since the location is updated in the index table 

sent to a decoder. every time the exchange changes from inactive to active. 

Transceiver 300 also includes a parallel-to-serial con- Various mcthods fof delcrmining which of the concurrc nt 
verier 308 which receives a stream of codewords from an cxch m activc ^ ^ ^ likelihood of pro- 
encoder and uses a clock signal from clock mulhpher 310 to cessi ffamcs QOt bc ^ Qnl fact0f ahcr factQre 
convert the stream of codewords into a serial bitstream. 15 inchldc nodc or ^ iorit dictcd rcs ^ nse time for 
Transmitter 312 then converts the serial bitstream into data frames of afl cxch and i imitat ions on numbers of 
signals suitable for transport by the transmit channel. Trans- simullaneously active exchanges of certain exchange types, 
ceiver 300 is typically provided on a network card, which If data frafflCS fof inacdvc data cxch are rcccivcd> t he 
resides on the I/O bus of a node. The mterface between the controUer5 will bc unablc to find the tracking information, 
transceiver 300 and the I/O bus is provided by a network 20 and ^ framcs bc rcjected Qr Uc(J tQ ^ a « Busy ,, 
mterface unit such as that shown in FIG. 4. COQtfol WOfd M that the transmitting node b promp ted to 

One embodiment of a network interface unit is provided rc _ send thc framc at a latcr time Alternatively, the software 

in FIG. 4. It includes an encoder 402 and a decoder 404 drivef may imposc limitations on the concurrent exchanges 

coupled to the transceiver 300. Encoder 402 and decoder to ensure that data framcs for i nact i ve exchanges are never 

404 provide error correction coding and decoding for infer- 2 5 processed, i.e. to ensure that the tracking information is 

mation transmitted across the serial link. Decoded data from always ava ii a ble for data frames being processed. 

decoder 404 is provided to receive controller 406. The _ , - . „ • m „, „ f tV _ 

. ii am . j .i i , 4 When using this arrangement, the assignment of the 

receive controller 406 stores received control words and data . r. u *■ a u * : - i ui 

- . . , ^ a no ir.i_ j • • « i exchange numbers may be performed by retrieving available 
frames in receive buffer 408. If the node is in a pass along , , J * i t • n n *u u 

j • . i_ cc a no * i j * u ^ exchange numbers from a stack. Initially, all the exchange 

mode, the receive buffer 408 is also used as a transmit buffer 30 . «i j u • •«• * a /« **ut 

A . n \ t1 „~ . . . , , j numbers are available, and as exchanges are initiated (either 

410. A transmit controller 412 retrieves control words and ... iij . *j\u u 

, t c c , t rc ii a 1 e j ,1 , by the local node or by a remote node) exchange numbers 

data frames from transmit burier 410 and forwards them to ' . . , r *\ c . , r A . 

. . 1 . • • . . , are retneved from the top of the stack. As exchanges are 

encoder 402. It the node is transmitting or receiving data ijj l \_ * j * <u u *♦ c 

.... , r j f .11 concluded, exchange numbers are returned to the bottom of 

P ar f, 1 P aUn 8 m an ex f™& 0f da,a >' '^.ve con<roller ^ ^ ^ ^ effort ^ and ^ 

408 updates exchange information in register nle 414 in 35 ..... - 4l 4 , . c , . 

r . f . , °T e , relatively infrequently, the assignment of exchange numbers 

response to received control words or data frames, and , J . . "j . , , . 

- r , , 4 £ . , , A r 4 , , •/ may be accomplished by device driver software, 
forwards data from received data frames to the node s i/o ' r ' 

bus. Transmit controller 412 updates exchange information Man y sequences may be initiated for each exchange and 

in register file 414 in response to commands and data from il fe desirable to provide a low-complexity method for 

the node's i/o bus, generates control words and data frames 40 hardware t0 a sequence ID number without the 

in transmit buffer 410, and forwards them to encoder 402. involvement of software. It is impractical to have software 

A processor at the local node may have access to register scao throu 8,!' aU lhe . act ,! ve ^changes to determine a unique 

file 414 via the I/O bus. In one embodiment, the manage- &e * utD <*. ID " umbe [ betweeD ' he «° ur ? and . destination 

ment of the network interface is done via a software driver nodes ' Smce ^ exchange numbers locally assigned to the 

resident in system memory. In this case, the incoming data 45 e«*«ig(. are already unique, mapping these numbers to 

.. .. u # a ac * sequence ID numbers ensures that the sequence IDs will be 

and outgoing data may be written to and read from system " M 

memory via DMA (direct memory access) channels. The u Q 1£ I ue - 

software driver determines when a data exchange is initiated In one embodiment, the network interface supports 64 

or concluded, and maintains a list of concurrent data active exchanges. As shown in FIG. 5, the sequence ID 

exchanges. Although there is no specified limit to the 50 number 502 is one byte, so setting the first six bits of the 

number of concurrent exchanges, it is likely that only a small sequence ID to the exchange number leaves two bits unas- 

number will be active (i.e. expecting that data frames for signed. These two bits may then be assigned by the hardware 

these exchanges will be sent or received in, say, the next 100 of mis embodiment in the following manner: sequences for 

microseconds) at any given time. The processor stores me SCS1 XFER_RDY command are assigned one hard- 

tracking information for the active exchanges in an 55 coded setting (e.g. 00), sequences for the SCSI RSP com- 

exchange table 416 in register file 414. To allow the receive mand are assigned a second hard-coded setting (e.g. 01), and 

and transmit controllers to quickly update the exchange data frame sequences alternate between the two remaining 

tracking information, the processor also provides an index settings (e.g. 10 and 11). This assignment of sequence ID 

table 420 in register file 414. The index table 420 has an numbers is easily handled in hardware. In one embodiment, 

entry corresponding to each possible exchange number, and 60 mc remote exchange ID is used. In another embodiment, the 

the value of the entries corresponding to active exchanges is originator exchange ID (0?C_ID) is used, 

set equal to the location of the tracking information in the Also shown in FIG. 4 is a buffer-credit manager 418. As 

exchange table 416. The receive or transmit controller described previously, before an initiating node can transmit 

needing to access or update the exchange table information a data frame to a responding node, it must first secure a 

can then first retrieve the exchange number from the frame 65 buffer credit from that node. Consequently, when receive 

header, reference the index table using this exchange num- controller 406 receives a control word indicating that a 

ber to determine the location of the tracking information in remote node wishes to transmit data, the buffer credit 
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manager 418 is enabled, and ihe transmit controller 412 
begins transmitting buffer credit control words in response 
to a credit signal from buffer credit manager 418. At the 
beginning of an exchange, the receive buffer 408 is empty of 
data frames, and the buffer credit manager 418 is provided 5 
with the negotiated frame size and the receive buffer 
capacity, and it is expected to generate and manage a number 
of buffer credits equal to the receive buffer capacity divided 
by the frame size, with as little delay as possible. 

Numerous variations and modifications will become 10 
apparent to those skilled in the art once the above disclosure 
is fully appreciated. It is intended that the following claims 
be interpreted to embrace all such variations and modifica- 
tions. 

What is claimed is: 15 

1. A computer network which comprises: 
a remote node; 

a local node coupled to the remote node by a serial 
communications link to conduct data exchanges with 2Q 
the remote node, wherein each data exchange is asso- 
ciated with an exchange identification number, wherein 
each data exchange comprises sequences of consecu- 
tive frames, and wherein each sequence transmitted 
from the local node is assigned a sequence identifica- 2S 
tion number by the local node, wherein the sequence 
identification number has a binary representation which 
includes a group of bits set equal to respective bits in 
a binary representation of the exchange identification 
number. 30 

2. The computer network of claim 1, wherein the 
exchange identification number is assigned to the exchange 
by the remote node. 

3. The computer network of claim 1, wherein the group of 
bits consists of six most significant bits in the binary 3f 
representation of the sequence identification number, 

4. The computer network of claim 1, wherein the local 
node includes a network interface unit having: 

a serial communications transceiver for driving transmit 
signals on a serial communications link and for buff- 40 
ering receive signals on the serial communications link; 

a transmit controller coupled to provide the transmit 
signal to the serial communications transceiver; and 

a receive controller coupled to receive the receive signal 
from the serial communications transceiver. 45 

5. The computer network of claim 4, wherein the transmit 
controller generates a frame header for each data frame in 
sequences transmitted from the local node, wherein the 
frame header includes the sequence identification number, 
and wherein the transmit controller determines the sequence 50 
identification number by appending bits to the exchange 
identification number. 

6. The computer network of claim 5, wherein the transmit 
controller appends a first set of bits and a second, different 



8 

set of bits to the exchange identification number, wherein the 
transmit controller alternates between the sets of bits for 
consecutive sequences in an exchange. 

7. The computer network of claim 4, wherein the network 
interface further includes a register file for storing an 
exchange table and an index table, wherein the exchange 
table has a predetermined number of slots for storing infor- 
mation about an exchange, and wherein the index table has 
an entry for each ongoing exchange to indicate which of the 
predetermined number of slots is storing information about 
the exchange; wherein the transmit and receive controllers 
are coupled to the register file to reference the index table to 
determine a current exchange table slot corresponding to a 
current exchange and thereby update information in the 
current exchange table slot. 

8. The computer network of claim 7, wherein a processor 
is coupled to the register file via a local i/o bus, wherein the 
processor is configured to support a number of concurrent 
exchanges, wherein the number of concurrent exchanges is 
greater than the predetermined number of slots in the 
exchange table, and wherein the processor is configured to 
free exchange table slots corresponding to ongoing 
exchanges which are inactive for a predetermined time. 

9. The computer network of claim 8, wherein the receive 
controller receives data frames from the remote node, 
wherein the receive controller accesses the exchange table 
slot corresponding to the exchange to which the data frame 
belongs to update a remote exchange identification number 
field. 

10. The computer network of claim 9, wherein the trans- 
mit controller accesses the exchange table slot correspond- 
ing to the current exchange to retrieve the remote exchange 
identification number for generating the sequence identifi- 
cation number for a data frame header. 

11. A method for managing concurrent data exchanges 
between a local node and one or more remote nodes coupled 
to the local node by a serial communications link, wherein 
the method comprises: 

determining an exchange identification number associated 
with each data exchange; 

appending bits to the exchange identification number to 
determine a sequence identification number; 

generating headers for data frames transmitted from the 
local node, wherein the headers include sequence num- 
bers indicative of the data exchange to which the data 
frames belong. 

12. The method of claim 11, wherein the determining an 
exchange identification number comprises: 

receiving a frame from a remote node; 
extracting the exchange identification number from a 
header in the data frame. 
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